Add telemetry for slash command usage #6381

roomote · 2025-07-29T18:50:58Z

Track usage of custom commands vs mode switch commands

Summary

This PR implements telemetry tracking for slash command usage in the Roo Code extension to help understand how users interact with slash commands.

Changes

New telemetry event: Added SLASH_COMMAND_USED event type to track slash command usage
Command detection: Implemented regex-based slash command detection with pattern /(?:^|\s)(\/[a-zA-Z][a-zA-Z0-9_-]*)(?=\s|$)/gm
Command classification: Distinguishes between "mode_switch" commands (like /code, /debug) and "custom" commands
Integration: Added telemetry capture in user input processing flow in Task.ts
Comprehensive testing: Added test suites for both detection logic and telemetry integration

Files Modified

packages/types/src/telemetry.ts - Added new telemetry event type
packages/telemetry/src/TelemetryService.ts - Added captureSlashCommandUsed() method
src/core/task/Task.ts - Integrated slash command detection and telemetry capture
src/utils/slashCommandDetection.ts - New utility for detecting and classifying slash commands
Added comprehensive test coverage for all new functionality

Testing

✅ All existing tests pass
✅ New test suites with 19 total test cases
✅ TypeScript compilation passes
✅ Linting passes with no warnings
✅ Covers edge cases like file paths, URLs, and invalid patterns

Usage Analytics

This will help track:

Which slash commands are most popular
Usage patterns between built-in mode commands vs custom commands
User engagement with the slash command feature

Important

Add telemetry tracking for slash command usage, distinguishing between custom and mode switch commands, with integration and testing across multiple files.

Telemetry:
- Added SLASH_COMMAND_USED event type in telemetry.ts.
- Implemented captureSlashCommandUsed() in TelemetryService.ts to log command usage.
Command Detection:
- Added regex-based detection for slash commands in slashCommandDetection.ts.
- Classifies commands as "mode_switch" or "custom".
Integration:
- Integrated telemetry capture in Task.ts and ChatTextArea.tsx.
Testing:
- Added test suite TelemetryService.slashCommands.test.ts with 19 test cases.
Misc:
- Updated Task.ts to handle telemetry in user input processing.

^{This description was created by}^{for 34b00c9. You can customize this summary. It will automatically update as commits are pushed.}

mrubens

@roomote-agent instead of command detection, just track if they click on an option in the slash autocomplete or the zap menu

daniel-lxs

LGTM

- Add SLASH_COMMAND_USED telemetry event type - Implement slash command detection with regex pattern matching - Classify commands as mode_switch vs custom types - Integrate telemetry capture in user input processing - Add comprehensive test coverage for detection logic and telemetry

- Remove detectSlashCommands utility and its usage from Task.ts - Add telemetry tracking to SlashCommandsList for popover clicks - Add telemetry tracking to ChatTextArea for context menu selections - Track both mode switches and custom commands with appropriate types - Delete unused slashCommandDetection.ts and its tests

roomote · 2025-10-20T18:08:01Z

Code Review Summary

I've reviewed the telemetry implementation for slash command usage tracking. The PR has 3 issues that need to be addressed:

Issues Found

Incorrect command type value (line 306): Using "mode" instead of "mode_switch" - this doesn't match the TelemetryService.captureSlashCommandUsed() type signature
Missing taskId parameter (lines 305-308): First telemetry call is missing the required taskId property
Missing taskId parameter (lines 320-323): Second telemetry call is also missing the required taskId property

Required Changes

Change commandType: "mode" to commandType: "mode_switch" on line 306
Add taskId property to both telemetry capture calls - you'll need to access the current task ID from the extension state or context
Ensure the telemetry client signature matches the backend TelemetryService.captureSlashCommandUsed(taskId, commandType, commandName) method

Context

The backend TelemetryService.captureSlashCommandUsed() expects three parameters:

taskId: string - The task ID where the command was used
commandType: "custom" | "mode_switch" - The type of command
commandName: string - The name of the command

The webview's telemetryClient.capture() is a lower-level method that doesn't enforce these parameters, which is why TypeScript isn't catching these issues.

roomote · 2025-10-20T18:10:53Z

webview-ui/src/components/chat/ChatTextArea.tsx

 				if (type === ContextMenuOptionType.Mode && value) {
+					// Track telemetry for mode selection from context menu
+					telemetryClient.capture(TelemetryEventName.SLASH_COMMAND_USED, {
+						commandType: "mode",


The commandType value should be "mode_switch" not "mode" to match the type signature of TelemetryService.captureSlashCommandUsed(taskId, commandType: "custom" | "mode_switch", commandName). This mismatch will cause the telemetry data to be inconsistent with the intended classification of mode switch commands.

roomote · 2025-10-20T18:11:25Z

webview-ui/src/components/chat/ChatTextArea.tsx

+					telemetryClient.capture(TelemetryEventName.SLASH_COMMAND_USED, {
+						commandType: "mode",
+						commandName: value,
+					})


The telemetry capture is missing the taskId property. According to the backend TelemetryService.captureSlashCommandUsed() signature and the telemetry schema, this event requires taskId, commandType, and commandName properties. The webview needs access to the current task ID to properly track slash command usage. Consider passing the task ID through the extension state or event context.

roomote · 2025-10-20T18:11:49Z

webview-ui/src/components/chat/ChatTextArea.tsx

+					telemetryClient.capture(TelemetryEventName.SLASH_COMMAND_USED, {
+						commandType: "custom",
+						commandName: value,
+					})


This telemetry capture is also missing the taskId property. The TelemetryService.captureSlashCommandUsed() method requires three parameters: taskId, commandType, and commandName. Without the task ID, the telemetry data won't be properly associated with the task context.

daniel-lxs · 2025-10-22T22:00:01Z

I don't think this is needed

roomote bot requested review from cte, jr and mrubens as code owners July 29, 2025 18:50

github-project-automation bot moved this to Triage in Roo Code Roadmap Jul 29, 2025

github-project-automation bot moved this to New in Roo Code Roadmap Jul 29, 2025

github-project-automation bot added this to Roo Code Roadmap and Roo Code Roadmap Jul 29, 2025

dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Jul 29, 2025

mrubens reviewed Jul 29, 2025

View reviewed changes

This comment was marked as outdated.

Sign in to view

hannesrudolph added the Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. label Jul 29, 2025

daniel-lxs moved this from Triage to PR [Needs Prelim Review] in Roo Code Roadmap Jul 31, 2025

hannesrudolph added PR - Needs Preliminary Review and removed Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. labels Jul 31, 2025

This comment was marked as outdated.

Sign in to view

daniel-lxs approved these changes Jul 31, 2025

View reviewed changes

daniel-lxs moved this from PR [Needs Prelim Review] to PR [Needs Review] in Roo Code Roadmap Jul 31, 2025

dosubot bot added the lgtm This PR has been approved by a maintainer label Jul 31, 2025

hannesrudolph added PR - Needs Review and removed PR - Needs Preliminary Review labels Jul 31, 2025

roomote and others added 2 commits October 20, 2025 11:51

hannesrudolph force-pushed the feature/slash-command-telemetry branch from 451d328 to 34b00c9 Compare October 20, 2025 18:07

roomote bot commented Oct 20, 2025

View reviewed changes

hannesrudolph moved this from PR [Needs Review] to PR [Needs Prelim Review] in Roo Code Roadmap Oct 20, 2025

hannesrudolph added the PR - Needs Preliminary Review label Oct 20, 2025

hannesrudolph removed the PR - Needs Review label Oct 20, 2025

daniel-lxs closed this Oct 22, 2025

github-project-automation bot moved this from New to Done in Roo Code Roadmap Oct 22, 2025

github-project-automation bot moved this from PR [Needs Prelim Review] to Done in Roo Code Roadmap Oct 22, 2025

daniel-lxs deleted the feature/slash-command-telemetry branch October 22, 2025 22:00

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add telemetry for slash command usage #6381

Add telemetry for slash command usage #6381

Uh oh!

roomote bot commented Jul 29, 2025 •

edited by ellipsis-dev bot

Loading

Uh oh!

mrubens left a comment

Uh oh!

This comment was marked as outdated.

Uh oh!

This comment was marked as outdated.

Uh oh!

daniel-lxs left a comment

Uh oh!

roomote bot commented Oct 20, 2025 •

edited

Loading

Uh oh!

roomote bot Oct 20, 2025

Uh oh!

roomote bot Oct 20, 2025

Uh oh!

roomote bot Oct 20, 2025

Uh oh!

daniel-lxs commented Oct 22, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Add telemetry for slash command usage #6381

Add telemetry for slash command usage #6381

Uh oh!

Conversation

roomote bot commented Jul 29, 2025 • edited by ellipsis-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Changes

Files Modified

Testing

Usage Analytics

Uh oh!

mrubens left a comment

Choose a reason for hiding this comment

Uh oh!

This comment was marked as outdated.

Uh oh!

This comment was marked as outdated.

Uh oh!

daniel-lxs left a comment

Choose a reason for hiding this comment

Uh oh!

roomote bot commented Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Code Review Summary

Issues Found

Required Changes

Context

Uh oh!

roomote bot Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

daniel-lxs commented Oct 22, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

roomote bot commented Jul 29, 2025 •

edited by ellipsis-dev bot

Loading

roomote bot commented Oct 20, 2025 •

edited

Loading